# Causal language model

ProGen2-xlarge is a protein generation model based on the foundational model proposed by Nijkamp et al., with modifications to its configuration and forward propagation.

ProGen2-base is a protein generation model based on the research by Nijkamp et al., supporting protein sequence generation and prediction.

ProGen2-small is a mirrored version of the protein generation model based on Nijkamp et al.'s research, with slight adjustments to the configuration and forward propagation process.

vortex-3b is a 2.78 billion parameter causal language model developed by OEvortex, based on the Pythia-2.8b model and fine-tuned on the Vortex-50k dataset.

Pythia - 2.8 billion is a member of the scalable language model suite developed by EleutherAI, designed specifically to promote the interpretability research of large language models. This model is based on the Transformer architecture and is trained on the The Pile dataset, with 2.8 billion parameters.

Thai causal language model based on GPT-2 architecture, trained on the OSCAR dataset

A GPT-2 language model trained on Tool band lyrics, capable of generating stylistically similar lyric texts

A GPT-2 language model fine-tuned on lyrics by The Notorious B.I.G., capable of generating text in a similar lyrical style

This is a Vietnamese causal language model with 1.3B parameters trained on Vietnamese news data

Russian abstractive summarization model based on rugpt3medium_based_on_gpt2, specifically trained on the Gazeta dataset

GPT-Neo 1.3B is a 1.3 billion parameter autoregressive language model developed by EleutherAI, based on the GPT-3 architecture, excelling in text generation tasks